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TITLE OF THE INVENTION 

IMAGE ENCODING METHOD, IMAGE DECODING METHOD, 
IMAGE ENCODING APPARATUS, IMAGE DECODING APPARATUS, 
IMAGE ENCODING PROGRAM, AND IMAGE DECODING PROGRAM 
5 BACKGROUND OF THE INVENTION 

Field of the Invention 

[0001] The present invention relates to an image 

encoding method, an image decoding method, an image 
encoding apparatus, an image decoding apparatus, an 

10 image processing system, an image encoding program, 

and an image decoding program capable of implementing 
efficient entropy coding of orthogonal transform 
coefficients in an orthogonal transform permitting 
selection among multiple block sizes. 

15 Related Background Art 

[0002] Encoding techniques of image signals are 

used for transmission and for accumulation and 
reproduction of image signals of still images, moving 
images, and so on. Such techniques include known 

20 international standard encoding methods, e.g., 

ISO/IEC International Standard 10918 (hereinafter 
referred to as JPEG) as an encoding technique for 
still images, and ISO/IEC international Standard 
14496-2 (MPEG-4 Visual, which will be referred to 

25 hereinafter as MPEG-4) as an encoding technique for 

moving images. A newer known encoding method is ITU- 
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T Recommendation H.2 64; ISO/IEC International 
Standard 14496-10 (Joint Final Committee Draft of 
Joint Video Specification, f tp// f tp . imtc- 

f iles . org/ j vt-experts/2 002 07 Klagenf urt/ JVT- 

5 D157.zip, which will be referred to hereinafter as 

H.2 6L), which is a video coding method intended for 
joint international standardization by ITU-T and 
ISO/IEC. 

[0003] Image signals demonstrate close 

10 correlations between spatially neighboring pixels and 

thus transformation into the frequency domain leads 
to deviation of information to the low frequency 
region, which enables reduction of redundancy by 
making use of the deviation. Therefore, the typical 

15 image encoding methods adopt a technique of 

subjecting image signals to an orthogonal transform 
to transform them into orthogonal transform 
coefficients in the frequency domain, so as to 
achieve deviation of signal components to the low 

20 frequency region. Furthermore, the coefficient 

values are quantized so that small-valued 
coefficients are converted into zeros. A coefficient 
string is made by reading the coefficients in order 
from the lowest in the low frequency region and is 

25 subjected to entropy coding taking advantage of the 

deviation of coefficient values, thus achieving 
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efficient encoding with reduction of redundancy. 
[0004] In this case, the Discrete Cosine 

Transform (DCT) is commonly used as the orthogonal 
transform in terms of encoding efficiency and ease of 
implementation. The orthogonal transform such as the 
DCT is carried out in units of blocks resulting from 
division of image signals into blocks each consisting 
of a plurality of pixels. The size of the blocks, as 
well as the property of the image signals, largely 
affects the encoding efficiency. 

[0005] When image signals demonstrate only small 

change in the spatial property, image signals to be 
transformed into orthogonal transform coefficients in 
a narrow frequency region are widely distributed on 
an image, and the redundancy can be reduced more with 
increase in the size of the blocks, i.e., the size of 
the orthogonal transform, so as to increase the 
encoding efficiency, as compared with cases using 
smaller blocks, which raise the need for repeatedly 
expressing identical orthogonal transform 

coefficients. When image signals demonstrate large 
change in the spatial property on the other hand, the 
increase in the size of blocks results in obtaining 
various frequency components of orthogonal transform 
coefficients thereof and thus decreasing the 
deviation of coefficients, which makes efficient 
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entropy coding difficult and thus decreases the 
encoding efficiency. 

[0006] In order to take advantage of the change 

of encoding efficiency due to the changes in the 
5 sizes of the blocks for the orthogonal transform and 

the property of image signals, the technology 
utilized is one of preparing orthogonal transform 
means in a plurality of block sizes in advance and 
adaptively selecting and using a size achieving the 

10 best encoding efficiency out of them. This 

technology is called Adaptive Block size Transforms 
(ABT) and is adopted in H.26L. Fig. lA-Fig. IE show 
orthogonal transform blocks used for the ABT in 
H.26L. The ABT permits a size achieving the best 

15 encoding efficiency to be selected out of four types 

of orthogonal transform block sizes shown in Figs. 
IB-IE, for each macroblock of 16x16 pixels shown in 
Fig. 1A. Pixel values of each macroblock are equally 
divided in units of blocks of the selected size and 

20 are then subjected to the orthogonal transform. By 

implementing such selection, it becomes feasible to 
achieve efficient reduction of redundancy through the 
use of the orthogonal transform in accordance with 
the change in the spatial property of image signals 

25 in the macroblocks. Reference should be made to 

H.26L as to more specific details of the ABT. 



4 



FP03-0157-00 



[0007] The entropy coding for the orthogonal 

transform coefficients obtained by the orthogonal 
transform is effected on a coefficient string 
obtained by sequentially reading the orthogonal 
5 transform coefficients from the lowest in the low 

frequency region. Fig. 2A shows an order of reading 
coefficients in an orthogonal transform block of 4x4 
pixels. Since the coefficients obtained by the 
orthogonal transform are arranged with the lowest 

10 frequency component (i.e., the dc component) at the 

left upper corner, the coefficients are read out in 
order from the left upper coefficient to obtain a 
coefficient string consisting of sixteen coefficients 
as shown in Fig. 2B. This reading order is called 

15 zig-zag scan. 

[0008] The coefficients obtained by the 

orthogonal transform are noncorrelated with each 
other, and the signal components deviate to the low 
frequency region. For this reason, when they are 

20 further quantized, the lower frequency coefficients 

are more likely to be nonzero coefficient values, so 
that many zero-valued coefficients appear in the 
coefficient string. For example, it produces a 
sequence of coefficient values as shown in Fig. 2C. 

25 Therefore, for efficient entropy coding of the 

coefficient string of this distribution, it is common 
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practice in encoding of images to perform the 
encoding by expressing the coefficient string by the 
numbers of continuous zero coefficients preceding a 
nonzero coefficient (runs) and coefficient values 
5 (levels) of the nonzero coefficients. Such encoding 

with runs and levels is also used in the entropy 
coding of orthogonal transform coefficients by the 
ABT . 

[0009] On the other hand, in order to increase 

10 the efficiency more in the entropy coding as 

described above, H.2 6L employs the technology called 
Context-based Adaptive Variable Length Code (CAVLC) , 
which is applied to the orthogonal transform without 
the use of the ABT, i.e., to cases where the 

15 orthogonal transform is always carried out in units 

of orthogonal transform blocks of 4x4 pixels. 
[0010] The CAVLC in H.26L utilizes the following 

features: the maximum number of coefficients in the 
coefficient string obtained from each orthogonal 

20 transform block of 4x4 pixels is 16, the magnitude of 

runs is restricted by this maximum number, and the 
magnitude of levels tends to be larger at lower 
frequencies. A number of encoding tables used in 
variable length encoding are prepared as optimized 

25 tables for respective conditions, and they are 

applied while sequentially being switched, so as to 
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increase the encoding efficiency. 

[0011] For example, in the case where runs are 

encoded in order, the first run can take a variety of 
values from 0 to 14 (according to the definition of 
runs in H.26L, the maximum value of runs is 14, which 
is two smaller than the total number of 
coefficients) . On the other hand, a run appearing in 
the last stage of the sequential encoding of runs can 
take only one of limited run values, because there is 
the upper limit to the number of coefficients in the 
coefficient string. Accordingly, as shown in Fig. 3, 
the right-side encoding table with the largest number 
of elements in the encoding table is applied to runs 
appearing in the initial stage, and the left-side 
encoding tables with the smaller number of elements 
in each encoding table are applied to runs appearing 
in the last stage. This permits assignment of codes 
of smaller bit counts and thus implements efficient 
entropy coding. The CAVLC achieves the efficient 
encoding by making use of the conditions such as the 
maximum number of coefficients in each block and 
placing restrictions on the range where values to be 
encoded can take. Reference should be made to H.2 6L 
as to more specific details of the CAVLC. 
SUMMARY OF THE INVENTION 

[0012] By applying the foregoing CAVLC to the 



ABT, it can be expected that more efficient entropy 
coding will also be achieved with the coefficient 
strings of the ABT. 

[0013] However, the CAVLC achieves the increase 

of encoding efficiency by optimizing the encoding 
tables in variable length coding for the respective 
conditions, based on the maximum number of 
coefficients in blocks, and applying the encoding 
tables to the encoding with switching among them. 
[0014] In use of the ABT, the number of 

coefficients in each block differs depending upon 
blocks of different sizes; 64 in the case of 8x8 
blocks in Fig. IB, 32 in the cases of 8x4 and 4x8 
blocks in Figs. 1C and ID, and 16 in the case of 4x4 
blocks in Fig. IE. For this reason, the application 
of the CAVLC requires consideration to the huge 
number of conditions that can occur in the respective 
cases . 

[0015] For example, supposing the encoding 

tables are set according to the maximum number of 
coefficients in coefficient strings, like the 
encoding tables of runs shown in Fig. 3, the huge 
number of encoding tables must be prepared; in the 
case of 8x8 blocks with the number of coefficients 
being 64, it is necessary to prepare the encoding 
tables ranging from the encoding table of the number 
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of elements being 2 to the encoding table of the 
number of elements being 62. Likewise, in the cases 
of 8x4 and 4x8 blocks with the number of coefficients 
being 32, the encoding tables must be prepared from 
that of the number of elements being 2 to that of the 
number of elements being 30. 

[0016] When the entropy coding adapted to the 

characteristics of coefficients like the CAVLC was 
attempted to be applied to the orthogonal transforms 
selectively using the orthogonal transform blocks of 
different sizes like the ABT as described above, 
there was the problem that the number of encoding 
tables to be prepared became huge and the memory 
capacity necessary for retention of the encoding 
tables became so large. Since it also involved the 
use of the different encoding tables for blocks of 
respective sizes and the different selection 
procedures thereof, there was the problem that the 
procedure in the entropy coding became complicated 
and thus implementing means and instrumental 
structure became complicated. 

[0017] The present invention has been 

accomplished in order to solve the above problems, 
and an object of the invention is to provide an image 
encoding method, an image decoding method, an image 
encoding apparatus, an image decoding apparatus, an 
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image processing system, an image encoding program, 
and an image decoding program enabling efficient 
entropy coding in the orthogonal transform of 
variable sizes. 

5 [0018] In order to achieve the above object, an 

image encoding method (apparatus) according to the 
present invention is an image encoding method 
(apparatus) of dividing image signals into blocks, 
performing an orthogonal transform of each block, 
10 reading resultant orthogonal transform coefficients 

to obtain a coefficient string, and performing 
entropy coding thereof, the image encoding method 
(apparatus) comprising: a block selecting step 
(means) of selecting a size of a block for the 
15 orthogonal transform, out of a plurality of blocks of 

different sizes; a coefficient string dividing step 
(means) of, when a block of a size larger than a 
minimum size is selected in the block selecting step 
(means), dividing a coefficient string in the block 
20 into a plurality of coefficient strings of a length 

equal to that of a coefficient string in a block of 
the minimum size; and an encoding step (means) of 
performing entropy coding adapted to the coefficient 
string in the block of the minimum size. An image 
25 encoding program according to the present invention 

is configured to let a computer execute each of the 
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above steps . 

[0019] In the image encoding method according to 

the present invention, as described above, when a 
block of a large size is selected to be subjected to 
5 the orthogonal transform, the coefficient string in 

that block is first divided into coefficient strings 
and then the entropy coding is carried out for each 
of them. This permits the entropy coding adapted to 
the coefficient string in the block of the minimum 
10 size to be applied to the entropy coding of the 

coefficient string in the selected block, whereby it 
is feasible to implement efficient entropy coding of 
orthogonal transform coefficients, without 

complicating the procedure of entropy coding. 
15 [0020] In the above image encoding method 

(apparatus) , the coefficient string dividing step 
(means) may be configured to read coefficients of the 
coefficient string from the lowest in a low frequency 
region and assign the read coefficients one by one in 
20 order to the plurality of coefficient strings of the 

length equal to that of the coefficient string in the 
block of the minimum size, thereby obtaining the 
divided coefficient strings. In the above image 
encoding program, the coefficient string dividing 
25 step executed by the computer may also be configured 

to read coefficients of the coefficient string from 
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the lowest in a low frequency region and assign the 
read coefficients one by one in order to the 
plurality of coefficient strings of the length equal 
to that of the coefficient string in the block of the 
5 minimum size, thereby obtaining the divided 

coefficient strings . 

[0021] In the above image encoding method 

(apparatus) , the coefficient string dividing step 
(means) may be configured to read coefficients of the 

10 coefficient string from the lowest in a low frequency 

region and repeatedly perform reading of coefficients 
by the number equal to the number of coefficients in 
the coefficient string in the block of the minimum 
size to obtain a divided coefficient string, thereby 

15 obtaining the divided coefficient strings. In the 

above image encoding program, the coefficient string 
dividing step executed by the computer may also be 
configured to read coefficients of the coefficient 
string from the lowest in a low frequency region and 

20 repeatedly perform reading of coefficients by the 

number equal to the number of coefficients in the 
coefficient string in the block of the minimum size 
to obtain a divided coefficient string, thereby 
obtaining the divided coefficient strings. 

25 [0022] An image decoding method (apparatus) 

according to the present invention is an image 
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decoding method (apparatus) of decoding encoded data 
encoded by an image encoding method of dividing image 
signals into blocks, performing an orthogonal 
transform of each block, reading resultant orthogonal 
5 transform coefficients to obtain a coefficient 

string, and performing entropy coding thereof, the 
image decoding method (apparatus) comprising: a block 
selecting step (means) of selecting a size of a block 
for the orthogonal transform, out of a plurality of 

10 blocks of different sizes; a decoding step (means) 

for performing decoding of the encoded data by 
entropy coding adapted to a coefficient string in a 
block of a minimum -size out of the plurality of 
blocks; and a coefficient string constructing step 

15 (means) of, when a block of a size larger than the 

minimum size is selected in the block selecting step 
(means), constructing a coefficient string of the 
block of the larger size from a plurality of 
coefficient strings decoded in the decoding step 

20 (means) . An image decoding program according to the 

present invention is configured to let a computer 
execute each of the above steps. 

[0023] In the image decoding method according to 

the present invention, as described above, when a 
25 block of a larger size is selected to implement 

decoding of the encoded data subjected to the 
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orthogonal transform, the coefficient string in that 
block is constructed from coefficient strings of 
blocks included in that block. This permits a 
coefficient string to be decoded from the encoded 
5 data by the entropy coding adapted to the coefficient 

string in the block of the minimum size, whereby it 
is feasible to implement efficient entropy coding of 
orthogonal transform coefficients, without 

complicating the procedure of decoding of entropy 

10 coding. 

[0024] In the above image decoding method 

(apparatus) , the coefficient string constructing step 
(means) may be configured to read coefficients in the 
plurality of coefficient strings decoded in the 

15 decoding step (means), from the lowest in a low 

frequency region and write the coefficients read out 
of the respective coefficient strings, one by one in 
order into a new coefficient string from the low 
frequency region, thereby obtaining the constructed 

20 coefficient string. In the above decoding program, 

the coefficient string constructing step executed by 
the computer may also be configured to read 
coefficients in the plurality of coefficient strings 
decoded in the decoding step, from the lowest in a 

25 low frequency region and write the coefficients read 

out of the respective coefficient strings, one by one 
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in order into a new coefficient string from the low 
frequency region, thereby obtaining the constructed 
coefficient string . 

[0025] In the above image decoding method 

5 (apparatus) , the coefficient string constructing step 

(means) may be configured to read coefficients in the 
plurality of coefficient strings decoded in the 
decoding step (means) , from the lowest in a low 
frequency region and write the read coefficients in 

10 units of the original coefficient strings into a new 

coefficient string from the low frequency region, 
thereby obtaining the constructed coefficient string. 
In the above image decoding program, the coefficient 
string constructing step executed by the computer may 

15 also be configured to read coefficients in the 

plurality of coefficient strings decoded in the 
decoding step, from the lowest in a low frequency 
region and write the read coefficients in units of 
the original coefficient strings into a new 

20 coefficient string from the low frequency region, 

thereby obtaining the constructed coefficient string. 
[0026] An image processing system according to 

the present invention comprises the above image 
encoding apparatus and the above image decoding 

25 apparatus . 

[0027] The image processing system enables 
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efficient entropy coding in the orthogonal transform 
of variable sizes because of the provision of the 
above image encoding apparatus and also enables 
decoding of codes entropy-encoded by the above image 
5 encoding apparatus, because of the provision of the 

above image decoding apparatus. 

[0028] The present invention will be more fully 

understood from the detailed description given 
hereinbelow and the accompanying drawings, which are 

10 given by way of illustration only and are not to be 

considered as limiting the present invention. 
[0029] Further scope of applicability of the 

present invention will become apparent from the 
detailed description given hereinafter. However, it 

15 should be understood that the detailed description 

and specific examples, while indicating preferred 
embodiments of the invention, are given by way of 
illustration only, since various changes and 
modifications within the spirit and scope of the 

20 invention will be apparent to those skilled in the 

art from this detailed description. 
BRIEF DESCRIPTION OF THE DRAWINGS 

[0030] Fig. 1A to Fig. IE are diagrams showing 

the orthogonal transform blocks used in the Adaptive 
25 Block size Transforms (ABT) of H.26L. 

[0031] Fig. 2A to Fig. 2C are diagrams showing a 
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readout method of reading coefficients in a 4x4 
block, and an example of a coefficient string after 
readout . 

[0032] Fig. 3 is a diagram showing the encoding 

5 tables of runs used in the Context-based Adaptive 

Variable Length Code (CAVLC) of H.26L. 

[0033] Fig. 4A to Fig. 4D are diagrams showing 

an example in which a method of readout and division 
of orthogonal transform coefficients according to the 

10 present invention is carried out for an 8x8 block. 

[0034] Fig. 5A to Fig. 5C are diagrams showing 

definitions of arrangement in original blocks, of 
coefficient strings after division according to the 
present invention . 

15 [0035] Fig. 6A to Fig. 6D are diagrams showing 

an example in which another method of readout and 
division of orthogonal transform coefficients 
according to the present invention is carried out for 
an 8x8 block. 

20 [0036] Fig. 7 is a block diagram showing a 

configuration of an image processing system according 
to an embodiment . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0037] The preferred embodiments of the image 

25 encoding method, image decoding method, image 

encoding apparatus, image decoding apparatus, and 
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image processing system according to the present 
invention will be described below in detail with 
reference to the drawings. The same elements will be 
denoted by the same reference symbols throughout the 
description of the drawings, without redundant 
description thereof . 

[0038] The description will be based on the 

premise that the encoding and decoding in the 
description hereinafter are implemented on the basis 
of H.26L, and the part without specific description 
about the operation in the image encoding is supposed 
to conform to the operation in H.26L. It is, 
however, noted that the present invention is not 
limited to H.26L. 

[0039] An embodiment of the present invention 

will be described. In the encoding according to the 
present embodiment, concerning the orthogonal 
transform coefficients in blocks of the respective 
sizes in the ABT of H.26L, a coefficient string 
obtained from each block is divided into a plurality 
of coefficient strings each consisting of 
coefficients in the number equal to the number of 
coefficients in a coefficient string of a 4x4 block. 
This makes it feasible to perform the entropy coding 
by the CAVLC of H.26L defined so as to be adapted to 
the 4x4 blocks. 
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[0040] It is assumed that in the encoding, 

first, the ABT in H.26L is applied to one macroblock, 
a size achieving the best encoding efficiency is 
selected out of the blocks shown in Figs. IB-IE, and 
5 the orthogonal transform is effected in units of the 

blocks of the selected size. 

[0041] It is also assumed that the CAVLC in 

H.2 6L is employed as the entropy coding of orthogonal 
transform coefficients. Namely, it is assumed that 
10 only the variable length encoding adapted to the 

encoding of orthogonal transform coefficients for the 
4x4 block shown in Fig. IE is defined. 

[0042] For example, let us suppose herein that 

the 8x8 block in Fig. IB is selected. The following 

15 readout operation of reading the orthogonal transform 

coefficients is carried out for this 8x8 block. 
First, sixty four coefficients in the 8x8 block are 
read out by zig-zag scan as shown in Fig. 4A, to 
obtain a coefficient string as shown in Fig. 4B. 

20 [0043] Then this coefficient string is divided 

into four coefficient strings each consisting of 
sixteen coefficients, the number of which is the same 
as the number of coefficients in the coefficient 
string of the 4x4 block. Here the coefficients in 

25 the original coefficient string are read out from the 

lowest in the low frequency region and alternately 
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assigned to the four coefficient strings, thereby 
obtaining the coefficient strings after division. 
Fig. 4C and Fig. 4D show this readout operation. 
Since the coefficients are alternately assigned to 
5 the respective coefficient strings from the lowest in 

the low frequency region, the first divided 
coefficient string is assigned the coefficients read 
out in the order of the zeroth, fourth, eighth, 
twelfth, . . . in the original coefficient string, and 

10 the second divided coefficient string is assigned the 

coefficients read out in the order of the first, 
fifth, ninth, thirteenth, ... in the original 
coefficient string. The third and fourth divided 
coefficient strings are not illustrated in Figs. 4A- 

15 4D. 

[0044] Similarly, when the 8x4 block or 4x8 

block of Fig. 1C or Fig. ID is selected, thirty two 
coefficients are divided into two coefficient strings 
each consisting of sixteen coefficients. The readout 

20 method for obtaining the divided coefficient strings 

is also similar to that in the case of the 8x8 block 
except that the number of coefficient strings 
alternately assigned the coefficients is 2, instead 
of 4; the coefficients in the original coefficient 

25 string are read out from the lowest in the low 

frequency region and alternately assigned to the two 

20 
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[0045] The coefficient strings obtained in this 

way are entropy encoded according to the same 
procedure as the encoding of CAVLC without the use of 
5 the ABT, and the encoded data is outputted in order 

as encoded data of orthogonal transform coefficients 
in the ABT block. 

[0046] At this time, the CAVLC of H.26L utilizes 

the space context to switch the applied encoding 

10 table on the basis of the number of nonzero 

coefficients in an adjacent 4x4 block. For this 
reason, arrangements of coefficient strings after 
division in the ABT blocks are defined for the ABT 
blocks larger than the 4x4 block. The definitions 

15 are presented in Fig. 5A to Fig. 5C . For example, 

the 8x8 block shown in Fig. 5A is handled on the 
assumption that the first divided coefficient string 
illustrated in Fig. 4C is located at the position of 
"1" and the second divided coefficient string 

20 illustrated in Fig. 4D at the position of "2." It is 

assumed that, using the definitions of the 
arrangement, the space context for the divided 
coefficient strings in the ABT blocks, or the space 
context for 4x4 blocks adjacent to the ABT blocks is 

25 handled in the same manner without any change as in 

the technique in the CAVLC of H.2 6L. 
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[0047] In the decoding, the original orthogonal 

transform matrix can be obtained according to the 
procedure reverse to the procedure in the encoding. 
[0048] Let us suppose that the ABT in H.26L is 

5 applied to one macroblock, a size is designated out 

of the blocks shown in Figs. IB to IE, and encoded 
data from this macroblock is one resulting from the 
orthogonal transform carried out in units of ABT 
blocks of the size. 

10 [0049] At this time the encoded data contains 

encoded data obtained by entropy coding of the 
divided coefficient strings by the CAVLC, in order as 
encoded data of orthogonal transform coefficients in 
the ABT blocks. Accordingly, it is sequentially 

15 decoded according to the procedure of CAVLC to obtain 

the coefficient strings after the division. 
[0050] Since these divided coefficient strings 

are coefficient strings divided by the readout method 
shown in Figs. 4A-4D, the original orthogonal 

20 transform coefficient block can be obtained by 

conversely writing the coefficients of the divided 
coefficient strings into each original coefficient 
string and further writing the resultant coefficient 
strings into the orthogonal transform coefficient 

25 block. The procedure thereafter is the same as the 

decoding procedure with application of the ABT in 

22 
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H.2 6L. 

[0051] A configuration of image processing 

system 1 for implementing the above image encoding 
and image decoding will be described below. Fig. 7 
5 is a block diagram showing image processing system 1 

according to an embodiment. The image processing 
system 1 is composed of image encoding apparatus 10 
for encoding image data, and image decoding apparatus 
20. 

10 [0052] The image encoding apparatus 10 has 

orthogonal transform unit 11, coefficient string 
divider 12, entropy encoder 13, and block selector 
14. The orthogonal transform unit 11 has a function 
of performing the orthogonal transform of image data 

15 to transform it into frequency components. The 

orthogonal transform unit 11 divides each macroblock 
of the image data into a plurality of blocks and 
performs the orthogonal transform of the divided 
blocks. It is connected to block selector 14, and 

20 the block selector 14 selects a block capable of 

implementing the orthogonal transform with the best 
efficiency. 

[0053] The coefficient string divider 12 has a 

function of dividing a coefficient string obtained by 
25 the orthogonal transform, into coefficient strings of 

a predetermined length. Here the term "predetermined 
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length" is defined as a length of a coefficient 
string obtained by the orthogonal transform of a 
block of a minimum size out of the blocks into which 
a macroblock can be divided for the orthogonal 
transform of image data by orthogonal transform unit 
11 . 

[0054] The entropy encoder 13 has a function of 

encoding the coefficient strings divided by the 
coefficient string divider 12. Since the coefficient 
string divider 12 divides the original coefficient 
string into the coefficient strings of the same 
length as that of the coefficient string of the 
minimum block as described above, the entropy encoder 
13 can be configured to be adapted for encoding of 
the coefficient strings of that length and can 
perform efficient encoding. 

[0055] The image decoding apparatus 20 has 

entropy decoder 23, coefficient string constructor 
22, inverse orthogonal transform unit 21, and block 
selector 24. The entropy decoder 23 has a function 
of decoding encoded data. 

[0056] The coefficient string constructor 22 has 

a function of constructing an original coefficient 
string from coefficient strings divided upon encoding 
by image encoding apparatus 10. The coefficient 
string constructor 22 is connected to block selector 
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24, acquires information about the size of the 
original block from the block selector 24, and 
constructs the original coefficient string on the 
basis of the information. The block selector 24 is 
5 able to acquire the size of the original block, based 

on additional information or the like transmitted 
with the encoded data from the image encoding 
apparatus . 

[0057] The inverse orthogonal transform unit 21 

10 has a function of transforming the coefficient 

strings constructed by the coefficient string 
constructor 22, into image data. 

[0058] The image processing system 1 of the 

structure as described above implements the 

15 aforementioned image encoding and image decoding. 

The aforementioned image encoding method and image 
decoding method can be substantialized by an image 
encoding program and an image decoding program for 
letting a computer execute each of the steps thereof. 

20 [0059] In the present embodiment the zig-zag 

scan was applied to readout of orthogonal transform 
coefficients, but the readout method of coefficients 
in application of the present invention does not have 
to be limited to the zig-zag scan. For example, the 

25 present invention may also be applied to cases of 

application of the field scan for field encoding in 
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interlaced images, which is defined in the ABT of 
H.26L. In this application, the dividing technique 
of the coefficient strings in the present embodiment 
can also be applied as it is. 
5 [0060] The present embodiment showed the 

alternate readout method as shown in Figs. 4A-4D, as 
a readout method for obtaining the coefficient 
strings after the division, but it is also possible 
to obtain the coefficient strings after the division 

10 by another readout method different therefrom. For 

example, as shown in Figs. 6C and 6D, sixteen 
consecutive coefficients each are read out from the 
original coefficient string from the lowest in the 
low frequency region and each series is assigned to 

15 one of the coefficient strings after the division. 

[0061] In the present embodiment, the readout of 

orthogonal transform coefficients in the encoding is 
implemented so as to first perform the first readout 
for obtaining the coefficient string from the 

20 orthogonal transform block and then perform the 

second readout for obtaining a plurality of 
coefficient strings after the division. The writing 
of orthogonal transform coefficients in the decoding 
is implemented so as to first perform the first 

25 writing for obtaining the coefficient string after 

construction and then perform the second writing for 
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obtaining the orthogonal transform block. However, 
the readout and writing of coefficients according to 
the present invention do not have to be limited to 
these methods, but may also be implemented by a 
5 variety of readout and writing methods that can 

obtain coefficient strings in the desired 
arrangement. For example, it is also possible to 
implement such readout as to immediately obtain a 
plurality of divided coefficient strings in the first 

10 coefficient readout from the orthogonal transform 

block. The writing from the divided coefficient 
strings may also be modified so as to immediately 
obtain the orthogonal transform block in the first 
coefficient writing . 

15 [0062] In the present embodiment, the 

coefficient strings after the division were arranged 
as shown in Figs. 5A-5C, and the space context from 
the adjacent 4x4 block in the CAVLC in H.2 6L was 
assumed to be handled without any change. In this 

20 regard, it can also be contemplated that the 

coefficient strings divided from the coefficient 
strings of the ABT blocks larger than the 4x4 block 
are originally different in the property from the 
coefficient strings in the case of the 4x4 block and 

25 weights are given to numerals used as the space 

context. Specifically, where the number of nonzero 
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coefficients is used as the space context from the 
adjacent block, a constant is always added to or 
multiplied by the number of nonzero coefficients in 
each divided coefficient string obtained from an ABT 
5 block larger than the 4x4 block, when used as the 

space context. In another configuration, where the 
coefficient strings after the division are obtained 
by continuously reading out the coefficients from the 
lowest in the low frequency region as shown in Figs. 
10 6A-6D, different constants may be added to or 

multiplied by coefficients read out from the low 
frequency region and coefficients read out from the 
high frequency region. 

[0063] The embodiments were described on the 

15 premise that the encoding and decoding were 

substantialized on the basis of H.26L and were 
described based on the ABT and CAVLC in H.2 6L. 
However, it is noted that the image encoding methods 
to which the present invention can be applied are not 
20 limited to H.2 6L, and the present invention can be 

applied to various image encoding methods permitting 
selection among a plurality of sizes of blocks for 
the orthogonal transform and using the entropy coding 
adapted to the orthogonal transform coefficients. 
25 [0064] The image encoding method, image decoding 

method, image encoding apparatus, image decoding 
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apparatus, and image processing system according to 
the present invention provide the following effect, 
as detailed above. Namely, where a size of a block 
for the orthogonal transform can be selected from a 
5 plurality of sizes, a coefficient string consisting 

of resultant orthogonal transform coefficients is 
divided into a plurality of coefficient strings of 
the same size as that of the coefficient string in 
the block of the minimum size and each of these 

10 coefficient strings is subjected to the entropy 

coding adapted to the coefficient string in the block 
of the minimum size; whereby it is feasible to 
implement the efficient entropy coding, without 
increase in the number of encoding tables in the 

15 entropy coding and without complicating the encoding 

tables and the procedure of selection thereof. 
[00 65] From the invention thus described, it 

will be obvious that the invention may be varied in 
many ways. Such variations are not to be regarded as 

20 a departure from the spirit and scope of the 

invention, and all such modifications as would be 
obvious to one skilled in the art are intended for 
inclusion within the scope of the following claims. 
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